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Abstract — Recent studies on control of aggregate power of 
an ensemble of thermostatically-controUed-loads (TCLs) have 
been concentrated on shifting the temperature set points of each 
TCL in the population. A sudden shift in the set point, however, 
is known to be associated with undesirable power oscillations 
which require closed-loop control strategies to regulate the 
aggregate power consumption of the population. In this article, 
we propose a new approach which we term as a "safe protocol" 
to implement the shift in temperature set point. It is shown 
analytically and verified numerically that by shifting the set 
point "safely" the aggregate power consumption can be changed 
to a different value within a time frame of the order of a 
TCL's cycle duration and avoid the undesired oscillations seen 
otherwise in a "sudden" shift. We discuss how the excess 
aggregate energy transferred under a safe shift in the set point 
could potentially mitigate the burden due to abnormal energy 
generation within a short time span. 

Keywords- Load control, ancillary services, hysteresis-based 
control, renewable energy. 

I. INTRODUCTION 

With increasing level of penetration of renewable energy 
sources into the power grid, focus of many recent studies 
has been on the potential of electrical loads in reducing 
generation-consumption mismatch. Higher intermittency and 
non-dispatchability associated with increased dependence on 
renewable energy sources can be better taken care of by elec- 
trical loads than by conventional generators ([1], [2]) which 
have much higher response time and usually offer more 
expensive and environmentally damaging way of mitigat- 
ing fluctuations in renewable generation. Thermostatically- 
controlled-loads (TCLs) account for about 50% of electricity 
consumption in the United States [3] and have been studied 
for their capability to perform generation-balancing ancillary 
services [4], [5]. 

For simplicity, we assume that our TCLs are air condi- 
tioners in houses of a large city. Such TCLs are working 
in cycles by switching between "ON" (drawing electrical 
power) and "OFF" (not drawing any power) states. We would 
assume that the power distribution authority has the ability 
to interfere in the process of operation of TCLs, which it 
intends to use for offsetting power fluctuations in the grid. 
Traditional focus on applied thermal load control has been 
either on direct interruption of power or on a sudden shift 
of the hysteresis-deadband around setpoint temperature of 
the TCLs [6]-[10]. The former approach can affect customer 
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interest if such disruptions happen for several hours in a hot 
day. Hence, the approach that is based on the centralized 
hysteresis-based control of the TCLs' deadband positions 
appears more attractive [4], [11]. In this case, power fluc- 
tuations in the grid are compensated by subtle 0.1"C) 
changes in the thermostat setpoint temperature. It is expected 
that such minuscale variations in thermostat setpoint will 
remain almost unnoticed by the customers. This minimally 
invasive approach should attract more customers and can be 
considered preferable for a large-scale commercial imple- 
mentation. The idea of shifting the operation band of TCLs 
has faced, however, with intrinsic problem of synchronization 
of TCLs. Simulations of a behavior of an ensemble of TCLs 
show that instead of eliminating unwanted power fluctuations 
in the grid, uniform "sudden" shift of setpoints of all TCLs 
can, without closed-loop feedback control, synchronize the 
TCLs and lead to strong unwanted power oscillations in the 
grid [4], [11]. 

In this article, we present a method to implement the shift 
in temperature setpoint of the TCLs, which we will refer to 
as the "safe protocol", that completely eliminates the TCL 
synchronization problem. We introduce a pair of "transition 
points" that govern the thermal dynamics of TCLs during 
the shift of setpoint temperature. Section [ll] describes the 
thermal dynamics of a large population of TCLs and the 



oscillation associated with setpoint change. Section III details 



the working of "safe protocol" while section IV computes 
an aggregated power and energy consumption during this 
process. Simulation results are presented in Section [V] while 
Section |VT] concludes with a brief summary of this work and 
future research direction. 

II. PROBLEM DESCRIPTION 




Fig. 1. Dynamics of temperature of a thermostatic load. 



Consider a "minimal model" of a single cooling type TCL 
[11]. The temperature, 9, of a TCL drops when it draws 
power (in the ON state) and increases when the TCL is not 
drawing any power (in the OFF state): 



e = 



-(^{e-ea,„b+PR), ON state 



(1) 



OFF state 



where Q,,,,,^ is the ambient temperature, C is the thermal 
capacitance, R is the thermal resistance, and P is the power 
drawn by the TCL when in the ON state. The dynamics 
forces a TCL's temperature into a hysteresis deadband from 
0_ to 0+ around the setpoint temperature 0^ = (0_ + 0+) /2. 
A TCL switches its state from OFF to ON when its 
temperature increases to 0+ and from OFF to ON when 
temperature drops to 0_. Solution of Eqs. ([T]i with such 
boundary conditions is shown in Fig.[T](top). Fig. [T] (bottom) 
shows that, at steady state, power consumption by a TCL 
switches between a constant and zero values, respectively in 
ON and OFF states. 

For a large heterogeneous {C,R and P values are different 
across the population) ensemble of TCLs, the aggregate 
power demand attains a steady state value [4]. In steady state, 
temperatures of all the TCLs would lie within the hysteresis 
deadband. Denoting 7^ and T/, as the mean times spent in 
ON and OFF states, respectively, the steady state probability 
density function of the ON state TCLs, f\ (0), and of the 
OFF state TCLs, /o(0), can be estimated as, [11]: 
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Fig. [2] shows the steady state probability distribution for 
a heterogeneous ensemble of TCL^ where the setpoint 
temperature is 20 "C with deadband width A = (0+ — 0^) — 
1.5 "C. Fig. 3]|4 show typical responses to a step change 
in temperature setpoint. Before the "sudden" change of the 
position of the deadband, the power consumption is almost 
uniform with small fluctuations resulting from a finite size 
of the TCL population and noise. When the temperature 
setpoint is suddenly shifted to a different value (keeping 
the width A constant), at around 10.8 hrs., the aggregate 
power demand breaks into a damped oscillatory mode before 



settling down onto a different steady state value. Figs. 3(a) 



= 10,000, eo,„(, = 32 "C; C,R and P follow lognormal distributions 
with mean 1 kWh/''C,2 "C/kW and 14 kW, respectively and a standard 
deviation of fj,, = 0.07 of the corresponding mean; a zero-mean Gaussian 
noise with standard deviation of 0.052''C /mirfi'^ was added to 




Fig. 2. Steady state probability densities. Small but nonzero values 
of probabilities beyond the deadband position are due to temperature 
fluctuations. 



and |3(b)| show the aggregate power and energy consump- 
tion corresponding to the setpoint increase in Fig. |3(c)| 
while Figs. 4(a) and 4(b) correspond to setpoint decrease in 



Fig. 4(c) The power profiles show large oscillations which 



are also reflected in the energy consumption profiles. 

While, for a fairly homogeneous system, a centralized 
control on a physically based model can be used to force the 
aggregate power into tracking certain reference signals [11], 
these parasitic oscillations in a heterogeneous population are 
hard to remove by centralized control signals because of ran- 
domness of parameters in the ensemble. Quite often, changes 
of the temperature setpoint in a range of 0.5 "C-l "C would 
be desirable from utility perspective. At such amplitudes, 
however, the parasitic disturbances of the system become a 
considerable problem that cannot be addressed by a linear 
control approach, which performs well for disturbances that 
are smaller than 0.1 "C. It is thus desirable to design a "shift" 
mechanism that eliminates the problem of synchronization 
and related power oscillations and yet exercises certain open- 
loop control over the energy consumption in a short duration 
(less than a time period of oscillation). 

III. THE SAFE PROTOCOL 

In this section we explain how a "safe protocol" would 
work. In a "sudden shift" of temperature setpoint, the new 
set of deadband limits are instantly applied to all the TCLs in 
the population which leads to a sudden jump in the aggregate 
power consumption. To avoid this, the shift of deadband 
limits will be applied to all the TCLs gradually in a certain 
way such that the new set of deadband limits are operative 
within less than a time period. Before we start to explain 
the mechanism, we need to clarify a concept of "transition 
points" to be used here: 

"Transition points" are intermediate hysteresis deadband 
limits that are operative starting from the instant the shift 
is initiated until the new set of deadband limits are applied 
across the population. Let 0*^ and 0^ be the lower and 
upper deadband limits before shift. If the temperature 
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Fig. 3. Power and energy consumption profiles under a "sudden" sliift to liiglier setpoint temperature. 





(a) (b) (c) 

Fig. 4. Power and energy consumption profiles under a "sudden" shift to lower setpoint temperature. 



setpoint is to be increased by an amount 5, then the 
transition points would be 0" and + While for a 
decrease in setpoint by an amount 5, the transition points 
would be (e'' - 5) and 9°. 

Let a signal be received by a TCL to shift the temperature 
setpoint by 5 (5 > for increase, while 5 < for decrease). 
At this moment this TCL can be anywhere on the original 
cycle. The "safe protocol" is constructed this way: 

1) This TCL continues to stay in its present state (ON or 
OFF) until it hits one of the transition points. 

2) Once it has reached one of the transition points, the 
new pair deadband limits, 0_ = (0" +5) and 0+ = 
(0^ + 5), start to govern its thermal dynamics. 

Fig |5] illustrates distinct stages of evolution of the proba- 
bility distribution over temperature in an ensemble of TCLs 
after it is perturbed by the "safe shift" of setpoint (in this 
case, an increase in setpoint). Before the initiation of the 
process, all the TCLs had their temperature lying between 
O'^ and 6^ (Fig. 5(a) i. Once the initiated each TCL continues 



with its state (ON or OFF) till its temperature hits either 
of the transition points, 0'* or 0^ + 5, as in Figs. 5(b) 
5(c)| Beyond time t = T2, the new set of deadband limits 
0_ = (00+5) and 0+ = (0^ + 5), are applied to all the 
TCLs in the population (Fig. |5(d)[ ). Finally the population 
settles itself to a distribution within the new deadband limits 



(Fig.[5(i)). 

If the period of the new cycle coincides with the period 
of the original cycle, 7)o,, then after time T,ot the ensemble 
of TCLs that is uncorrected before the control signal will 



be in the uncorrected state. This follows from the fact that 
the rate of TCLs arrivals at the transition point is constant 
and all TCLs pass through it during T,ot - just as in the case 
of uncorrected steady state with the new deadband position. 
Hence, the final distribution of TCLs over temperature is 
the same as it would be at steady state conditions with the 
new position of the deadband. This "strict version" of safe 
protocol requires to install some sort of a "smart meter" on 
the TCL, which would learn the local parameters C,R, QamhiP 
and original deadband width Aq and accordingly set the new 
deadband width A so that the new time period Ttot equals 
original time period TJ^,. 

However it is observed that the relative change in time 
period, TJ7, is generally very small. Using the parameters in 
Section [nj the change in time period for a shift 5 = \°C 
comes out to be 



: 0.015 



(4) 



In our example, with initial setpoint temperature at 20"C and 
ambient temperature at 27 — 35"C, a shift of the order of 
VC would cause only about 2% change in the time period. 
Considering local temperature fluctuations and variation of 
parameters with time, the impact of such change of time 
period (777- ^ 1) on successful implementation of safe pro- 
tocol would be imperceptible. Tjr would be significant when 
setpoint temperature is either very close to or quite below 
ambient temperature, neither situation is not controllable as 
almost all the TCLs are either OFF or ON. Hence we propose 
a "light version" of safe protocol would be sufficient, where 



(a) Initiation of the process, t = 



(b) < r < T| 



(c) T, <t<T2 




(d) T2 < f < "^3 (e) Completion of tlie process, t = 

Fig. 5. Clianges taking place in the probability density of ON and OFF profiles when 5 > 0: (a) Initial equilibrium distribution, (b) No switching at 6^ 
while switching continues at 65. (c) Switching starts at 9+ while switching continues at 9^ until all of the initially ON TCLs have switched to ON once, 
(d) Both new deadband limits are now activated and the first set of ON TCLs are approaching 6_. (e) New equilibrium distribution is attained within the 
new deadband limits. 



local deaband adjustments to maintain a strictly same time 
period is not necessary. Fig. |5] depicts this scenario when the 
only setpoint shifts but the deadband width remains fixed 
allowing the time period to change. 

IV. POWER AND ENERGY CONSUMPTION 

In this section, a time response of the aggregate power, 
Ptot{t), and energy consumption by the TCLs to a shift in 
the temperature setpoint under the safe protocol is derived 
assuming homogeneity of parameters. 

In the steady state, the out-flows and in-flows of both the 
ON state probability and the OFF state probability remain 
equal. Assuming t be the time a TCL (in a homogeneous 
population) takes to heat up from 0,, 0, e to 0+, 

the number of TCLs going from OFF to ON state in time t 
would be 



A^Vn 



0,1 



fo{9)d9, 9t — Oamh — ( 9amb — 9+) eC 
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{using (2|) 



(5) 



Tc + Th 

By similar calculation for the ON state, the number of TCLs 
going from ON to OFF in time t is 

t 



(6) 



thus maintaining the steady state probability distribution, i.e. 
zero net in/out-flow. We also note, that in the steady state 
the number of TCLs in the ON state, A^i , and the number of 
TCLs in the OFF state, A^o^ can be written as 

Ttot 
Ttot 



J 



(7) 



We assume that the TCLs were operating in a steady state 
between deadband limits 0" and 9^. When the signal to 
shift the deadband to the right by an amount 8 is received 
by the TCLs at, say, time instant t — (Fig. \5(a)\ the TCLs 
keep on operating under their current state until they hit one 
of the "transition points", 0" and 0+ = (0°+5). In the 
next three sub-sections we will address the different stages 
through which the shift takes place. 

A. Power Profile: <t <Ti 

The steady state aggregate power consumption of the 
population, at time f = 0, is 



PtotiO) 



-NP {using (D) 



tot 
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Pmax NP 



(8) 



where, is the original cooling cycle duration, before the 
shift was initiated. Once the (right) shift process is initiated at 
f = 0, the transition points, 0*^ and 0+ — (0^ + 5), become 
operative. Hence TCLs that were in the OFF state do not 
switch to ON state until a time T which is same as the time 
taken by a TCL to heat up from 0^ to 0+, given by 



Ti = CR In 



umh 
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(9) 



The TCLs that were in the ON state at f = 0, however, keep 
on switching to OFF state as they hit the transition point 0" . 
Hence, assuming that 5 is small enough to ensure Ti < T^f', 
there will be a net out-flow of TCLs from ON to OFF during 
the time f G (0, Ti]. The number of TCLs going from ON to 
OFF between time t — and f = f is AA^J q — tN /Ttot (from 
(|6]l). Assuming the total cycle duration Ttot to remain almost 



unchanged throughout the shift process (from Q), and using 
(|8]l and (|6|, we have 



P,o,{t) = 



Vf e (0,Ti] 



(10) 



B. Power Profile: Ti < f < T2 

After f = Ti, TCLs come into the ON state at a rate N/Ttot 
(from (jsll) and go out of the ON state at the same rate N/Ttot 
(from ensuring that the net out-flow (or in-flow) in the 
ON state remains zero (Fig. |5(c)| l. This continues to happen 
until all the TCLs that were originally ON (at f = 0) make the 
switch to OFF state, at time t — X2- Since is the original 
cooling cycle duration, clearly 



& 



T2 = 
Ptol{t) = 



Vf e (ti,T2] 

Pmax, Vfe(Ti,T2] (11) 



C. Power Profile: T2 < f < T3 

At f = T2 all the originally ON TCLs make the switch 
to OFF state. Beyond f = T2 (Fig. 5(d) 1 there is in-flow of 
TCLs to ON state at a rate N/Ttot but no out-flow, thereby 
resulting in an increase in the total power consumption. This 
continues till time f = T3 when the current (f — T2) ON state 
loads start hitting the new lower deadband limit 0_ — 9^+5. 
Since starting at f = Ti , it takes time T^ (new cooling cycle 
duration) for the TCLs to start switching from ON to OFF, 
again, we have 
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D. Power Profile: f > T3 

Fig. |5(e)| shows the situation at a time t > T3, where the 
TCLs are operating according to their new steady state prob- 
ability distributions, and the aggregate power consumption is 
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(using [11] & (12)) 



(13) 



This completes the derivation of Ptot{t) for 5 > and Ti < 

■ 

E. Other Operating Regimes 

1 ) Large Deadband Shift: The case Ti > T^f' occurs when 
5 is reasonably large, in which situation the total power 
Ptot{t) goes to zero at time t = T^ < Ti and thereafter stays 
at Piot{t) ~ until f = Ti + Ti, at which point the OFF state 
TCLs start making transition from OFF to ON and so P(„,(f) 
starts to increase linearly before reaching the new steady 
state at f = Ti + 7/, + after which total power consumption 
stays at Ptot{t) = PmaxTc/Ttot- 



2) 5 < 0.- The situation when the deadband is shifted to 
left (5 < 0) can be analyzed quite similarly. Here we only 
present the final form that Ptot{t) is going to have 
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A = TS^^i = ^'i+Th and 



F. Total Energy Consumed in the Process 

At f < 0, the population of TCLs consumes energy at a 
rate Ptoti^) = PmaxT^ /Ttot, in and after f > T3 at a rate 
Ptoti'^3) = PmaxTc/Ttot- During the time interval [0,T3] the 
total energy consumed can be expressed as 

£0,T3 = ^^1 {PtoM +Pto,{Tl)) + (T2 - Ti)P,„,(Ti) 
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V. NUMERICAL RESULTS 



(15) 



Figs.[6|7]illustrate the effect of application of the light ver- 
sion of the safe protocol on an ensemble of TCLs (parameters 
given in Section |ll]) under step changes in setpoint temper- 
ature. The large oscillations, visible otherwise in Figs. 3]|4 



disappear and the population attains the new steady state 
within the time period Ttot of the TCL's cycle. It also results 
in a steady change in energy consumption within a time 
period duration. Fig. |8] shows how this safe protocol fares 
under increasing heterogeneity measured by the standard 
deviation of the lognormal distribution of paramaters iC,R 
and P), which is a factor, Op, of corresponding mean. As 
<Tp increases, the actual response deviates further away from 
theoretically estimated response. But most importantly, the 
large fluctuations do not appear and the power response 
settles to the new steady state within a time period duration. 



VI. CONCLUSION 

We proposed a method to implement simultaneous shifts 
of the deadband positions in a large heterogeneous popula- 
tion of TCLs without inducing parasitic power oscillations 
in the power grid. Our method is helpful in getting rid of the 
unwanted oscillations at the onset of a deadband shift and 
could be a tool in demand side energy management. Using 
the knowledge of the energy consumed in a deadband shift 
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Fig. 6. Power and energy response under a "safe" shift to higher setpoint temperature. 
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Fig. 7. Power and energy response under a "safe" shift to lower setpoint temperature. 
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Fig. 8. Performance of "safe protocol" to input in Fig. |7(c)| under varying 
lieterogeneity. 



under the safe protocol a population of TCLs could poten- 
tially be used to compensate for the over/under-generation 
of renewable energy within a relatively short duration, about 
the time period of the operation of a TCL. Potentially, 
nonperturbative control of TCLs can be equivalent to the 
additional possibility of manipulating the power of up to 
100 MW in a city with a million houses. While this method 
is concerned with load-side energy management, suitable 
feedback control may be designed to utilize the absence of 
parasitic oscillations and track the fluctuations in generation. 
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